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Landau's quantization for incompletely nested Fermi surfaces is known to give rise to magnetic- 
field-induced spin-density waves(FISDW) in two-dimensional organic metals. Here we show that 
three-dimensional(3D) systems can have 3D-specific series of FISDW phases as energetically stable 
states, for which we clarify how and why they appear as the magnetic field is tilted. Each phase is 
characterized by quantized Hall effect for each of a xy and a zx that reside on a fractal spectrum like 
Hofstadter's butterfly. 
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I. INTRODUCTION 

Rich electronic states arising from nesting of Fermi sur- 
faces continue to provide fascination in various classes 
of materials. Organic crystals provide particularly vet* 
satile Fermi surfaces, and it has indeed been shownEl 
that a curious series of spin density wave (SDW) states 
emerge in strong magnetic fields in a family of quasi- two- 
dimensional organic conductors (TMTSF) 2 X (X=PF 6 
etc), called the Bechgaard salt. The field-induced spin 
density wave (FISDW) occurs when the nesting of the 
Fermi surface is incomplete. The Landau quantization in 
the pockets formed as a result of an incompletely nesting 
then causes-.a series of gaps to appear around the main 
SDW gapnu. Since Ep always lies in the largest Lan- 
dau gap, an integer quantum Hall effect arises. When 
the magnetic field is increased, successive phase transi- 
tions take place because the energetically favorable SDW 
nesting vector jumps along the way, which results in dis- 
continuous changes of the Hall conductivity. This has 
been considered for the TMTSF compounds that hap- 
pens to have very anisotropic transfer energies between 
molecules with t x : t y : t z ~ 1 : 0.1 : 0.003, so that the 
system is almost perfectly two-dimensional(2D). 

So a challenging problem we address here is: (i) can we 
have such Landau-quantization-assisted FISDW states 
in three-dimensional (3D) systems, not as a remnant of 
the 2D FISDW but as 3D-specific, energetically favor- 
able states, and if so, (ii) how and why de. the succes- 
sive phase transitions arise in 3D? Lebedla introduced 
the third direction hjMwping to FISDW for the first time, 
and several authors&E§El studied the quantum Hall effect 
in 3D FISDW, where Hall conductivities a xy and a zx 
are predicted to be quantized respectively. However, the 
condition for the emergence of 3D FISDW phase itself 
has not been worked out except for a limited case f< 
(TMTSF)2X where three dimensionality is very smal 
So it has remained to be clarified whether and how 
FISDW phases really do exist in 3D. 

This is exactly the purpose of the present paper. We 
consider a possibility of FISDW phases in 3D systems in 
magnetic fields, where we shall show that the favorable 



situation is anisotropic 3D systems with an anisotropy 
such that the transfer energies satisfy t x ^> t y ~ t z (as 
contracted with t x > t y > t z in (TMTSF) 2 X). With 
varied magnitude and orientation of the magnetic field 
B = (0, By, B z ), we have optimized the SDW nesting 
vector to show that a series of 3D FISDW phases do 
indeed exist, which is best expressed as a phase dia- 
gram against (B y ,B z ). The phases comprise rich fami- 
lies, where they are characterized by quantized Hall con- 
ductivities a xy and a zx as one hallmark of the 3D-nature. 
On the energy axis, the FISDW is seen to reside^ap a frac- 
tal energy spectrum like Hofstadter's butterflyEHl, which, 
curiously, also indicates the 3D-specific nature of the 3D 
FISDW. In fact this can be regarded as one realization, 
through a density-wave formation, of the butterfly and 
the quantum Hall effect ip-3D we have proposed on a gen- 
eral mathematical basis. M An intuitive reason why the 
butterfly spectrum arise in the 3D FISDW is discussed in 
terms of the topology of the incompletely nested Fermi 
surface in 3D in the final section. 



II. FORMULATION FOR THE 3D FISDW 

We consider a simple orthorhombic metal with an en- 
ergy dispersion 



e(k) 



-t x cos k x a — t v cos k y b — t z cos k z c, 



(1) 



where a, 6, c are lattice constants and the transfer ener- 
gies are assumed to satisfy t x 3> t y ,t z (i.e., quasi- ID). 
The dispersion along k x around the Fermi energy can be 
approximated as a linear function Wi?(|fe x | — hp) (with 
h = 1 and e(fe) measured from Ep), while the three- 
dimensionality (warping of the Fermi surface) can be de- 
scribed by the leading-order expansion in t y and t z as 



e(k) = v F (\k x \ - hp) + e±(k ± ), 
= —ty cos k y b — t z cos k z c 

t' cos2k z c 



(2) 



—t' cos 2k y b 



-t' yz [cos^fe + k z c) + cos(k y b — k z c)\ , (3) 



where k± = (k y ,k z ), and 



1 



t'y = at 2 y /t x , 
t z <xt z jt x ^ty Z — 2,(y.tyt z /t x 



(4) 



with a = — (cos k pa) /(Asm kpa). 

Let us apply a magnetic field (0, B y , B z ) normal to the 
conductive axis x. We take the spin quantization axis 
parallel to z. We assume that an SDW-,is the most likely 
instability as in the Bechgaard saltsJH and look at the 
mean-field equation for the wave function with the 3D 
nesting vector q — (q x , q y ,q z ) can be written as 



E-H x (x) A(x) 
A* (*) E-H L (x) 

H^(x) = ~iv F d x + e±(k± 

H±(x) = +ivpd x + e±(k± 



u(x) 
v(x) 

eA ± ), 

q ± - eA± 



= 0, 



(5) 



where Aj_ = (B z x, —B y x) is the vector potential, and 
the band energy measured from —vpkp. H^(H\) is the 
Hamiltonian for an electron on the right Fermi surface 
with up-spin (or on the left Fermi surface with down- 
spin), while u(v) is the corresponding wave function for 
an up-spin electron on the right Fermi surface (down- 
spin on the left). A(x) represents the mean- field elec- 
tron interaction, which can be approximately written as 
a single- mode function A(x) ~ Ae lqmX . We determine A 
and q self-consistently so as to minimize the free energy 
at T = (i.e., the ground state energy). The SDW also 
mixes down-spin states around the right Fermi surface 
and up-spins around left Fermi surface, which defines an- 
other order parameter. The phase difference between the 
two order parameters specifies the spin order direction on 
the xy-plane. 

If we separate out the ej_ — dependent phase as 



£±(k± — eA±)dx' 



u(x) 


= u(x) exp 


'"f 

. V F Jo 


v(x) 


= v (x) exp 


Vf Jo 


A(x) 


= A(x) exp 


( v F „ 




+e±{k± - 


-q ± -e 



Eq.(||) reads 



E + ivpd x A(x) 
A*(x) E~ivFd x 



u(x) 
v(x) 



= 0, 



(6) 



(7) 



where the effect of the magnetic field is included in the 
off-diagonal part, A. When we plug Eq.(||) into A, we 
obtain 



A(x) = Ae zq * x JnA z i)Jn 2 (z2) x ... x J„ 6 (z 6 ) 



xe 
with 



rii...n 6 

-z(ni+2n3+n5+ri6)Gb^— 1(^2+2714+715— tiq)G c x+iS 



(8) 



Zi = 2t y /(G b v F ) cos(q y /2), z 2 = 2t z /(G c v F ) cos(q 2 /2), 

z 3 = t' y /{G b v F ) cos q y , z 4 = t' z /(G c v F )cosq z , 

z 5 = t' yz /[(G b + G c )v F ] cos[(q y + q z )/2], 

z 6 = t' yz /[{G b - G c )v F ] cos[(q y - q z )/2], (9) 

where J n is the Bessel function, 

G b = eB z b, G c = eB y c, 

and 5{q y ,q z ) is a phase factor independent of x. The 
summation in Eq. (^) can be rearranged into 



A(x) = A]T/„ 



D i(g x —mGb — nG c )x+i5 



(10) 



where I mn is a summation of products of J rl 's. We 
can see that the energy gaps of width |A/ m „| open at 
k x = ±^(q x — mG b — nG c ). Since the Fermi energy (at 
k x = ik F ) must lie in the largest gap to minimize the 
energy, we obtain 



1 



(q x — MG b — NG C ) = k F , 



(11) 



where M,N are m,n that give the largest I mn . Thus 
the x component of the.. SDW nesting vector becomes 
q x = 2k F + MG b + NG c .a Here we assume k F G b , G c , 
which is reasonable as long as typically B < 10 4 T. 

To be precise, the gaps other than the one at E F can af- 
fect the stability of the FISDW, but in the weak-coupling 
regime at T = we can show that the stability of the 
FISDW phase is determined by the width of the gap in 
which E F resides. Suppose G b /G c is rational with 



where 
can 



G b = P G, G c - qG, 

re p, q are mutually prime integers. Equation ( |l0| ) 
then be rewritten as 

A(x) = A^/ ;e ^- /G )*+ l5 , 



(12) 



where // is the summation of I mn over those (m, n) sat- 
isfying mp + nq = I. The energy spectrum has a gap 
at k x = ±\{q x — IG) for each integer I. We consider 
the situation where the gap widths are smaller than the 
gap intervals. We can then express the energy dispersion 
along x in the extended zone (shown in Fig. pi) as 



E ± {k x ) = e+Y. 



sgn^ - le)^W^WT\KW 



(13) 



where ^(kx) = ±hvp(k x =F hqx) are the dispersions for 
A = measured from the gap at / = for the right 
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(£+) and left (£ ) Fermi surfaces with e = TivpG/2. The 
energy gained by opening the gap in the metallic state is 



F = 



JAP 

VQ 



fe,± 



(14) 



Here vq(> 0) is a molecular-field constant, and the sum- 
mation taken over E F — £ c < E ± {k x ) < E F , where £ c is 
a cutoff. If we insert Eq.(|l3|) into this equation, we have 



F = 



JAjf 



Ar 



1 + log ■ 



-D J2\&lL+i\ 2 \og 

Z#0 



le 



£ c + le 



(15) 



where L is the index of the gap that contains Ep, and 
Da is the density of states for A = which is assumed 
to be a constant. From the gap equation, dF/d\ A| 2 = 0, 
we obtain 



I AM = 2£ c exp 



-1 



\Il\ 2 v D q 



E 




-Co 1 



I Air 



(17) 



Thus A in general depends not only on the width of the 
gap at Ep (oc /l) but also those of other gaps. In the 
weak-coupling limit v$ — > 0, however, A is mainly de- 
termined by the factor exp[— 1/(\Il\ 2 voDo)]. So larger 
II gives larger A in (|l6|), which gives smaller F in (17). 
Therefore, we only have to maximize I in order to mini- 
mize the free energy. 



III. PHASE DIAGRAM AND HALL 
CONDUCTIVITY 



We have obtained the phase diagram against (B y , B z ) 
by maximizing i mn ((/j,, f/ z ) f° r mesh points on (B y ,B z ) 
and {q y ,q z ) around (tt,tt). Fig. || shows the result for 
ty = t z (a) and t y > t z (b). In both cases we do have a 
series of phases that are characterized by (M, TV) defined 
in Eq.(ll). An essential finding here is that there are 
FISDW phases specific to 3D, which exist only when both 
ty and t z are nonzero. We can see this by comparing Figs. 
||(a)(b), where the 3D-specific phases (shaded) are seen 
to shrink as t z /t y — » 0. The 3D-specific phases are clas- 
sified into several families: (M, TV) = (TV, —TV) phases ly- 
ing along 9 = taxr 1 (B y /B z ) = 45°, and (-2TV, 0) phases 



B (Lebed's angle, corresponding to 45° in our model for 
b — c). The Sun-Maki phase is possibly related to the 
present 3D phases, although it does not belong to the 
(TV, —TV) family here. 

The integers (M, TV) have an important physical mean- 
ing — the Hall conductivity. Following Yakovenko's for- 
mulation for 2Do, Sun and MakiU have predicted that 
the FISDW phase having (M, TV) should have Hall con- 
ductivities ((J xy ,<T Z aA = ^-(M, TV) (2: spin factor). In 
our previous papertll that demonstrated a realization of 
Hofstadter's butterfly in non-interacting 3D systems, we 
have obtained the quantum Hall integers residing on the 
fractal spectrum by making use of Streda's formula fol- 
lowing Halperin-Kohmoto-Wuli3, where these integers are 
identified to be topological invariants assigned to each 
gap in the butterfly. If we apply this general argument 
to the FISDW problem treated here, the result coincides 
with Sun-Maki's. What is interesting about the FISDW 
states considered here (t y ~ t z ) is that the wild variation 
of (M, TV) with the magnetic field accompanies a wild 
variation in the quantum Hall conductivities. 

The mathematical origin of the 3D phases can be 
traced back to the basic equations above (while we dis- 
cuss the intuitive reason later). For 6 — > 45°, Gb — G c 
vanishes and the argument of one of the Bessel func- 
tions, J n6 (z§), diverges. Since J n {z) has the maximum at 
z ~ n, A(x) has a large Fourier component e - m a(G b -G c )x 
with a nonzero n$. If we assume other z's are small, 
I mn has a maximum at (m,n) = (ng,— n^), which cor- 
responds to the (TV, —TV) phases. Similarly, (— 2TV, 0) 
phases correspond to the divergence of 2:3 oc l/Gb- 

Now we come to the stability of the 3D phases. When 
we go from the 3D systems over to 2D (t z (or t y ) — > 0), 
the 3D phases vanish and we are left with the 2D phases 
with TV, 0(0, TV) that depend only on B z {B y ), as seen 
from Fig. |(b). These phases are known for (TMTSF) 2 X, 
while the 3D phases are new. The nesting vector (q y ,q z ) 
is pinned to (ir, ir) in the (TV, —TV) and (— 2TV, 0) phases, 
while in the 2D (TV, 0) phases and some of 3D phases the 
nesting starts to deviate from (ir, ir) with TV. We also 
notice that the 3D phases do not require very large mag- 
netic fields. In fact, when B y or B z becomes too large 
the 3D phases give way to 2D ones even when t y ~ t z as 
seen in Fig. |^(a). This is because a large in-plane com- 
ponent of B tends to confine the electron motion within 
each layer so that the system becomes 2D-likc. 



The 3D FISDW phases with larger integers are less 
stable since I mn (width of the energy gap) generally de- 
creases with increasing m,n. Hence the FISDW should 
become unstable when the magnetic field is too close to 
around (B y ,B z ) ~ (0.1, 0), -etc, and their mirror images 6 = 0,45°, or 90°, where the Hall integers diverge. In 

this region, some metallic phase may become stable, or 
some FISDW with (q y ,q z ) far from (tt,tt) may appear, 
while we have studied the range 0.97T < q x ,q y < n here. 



(B y «-> B z ). Sun and MakiB have shown that a small t z 
in (TMTSF) 2 X (i.e., t' z oc t\ neglected) can give rise to 
a phase with nonzero M, TV just at a particular angle of 
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IV. ENERGY SPECTRUM 

The second key result in this paper is the quasi-particlc 
spectrum, which is plotted against B z /B y in Fig. ||(a). 
A structure reminiscent of Hofstader's butterfly are con- 
spicuous around the Fermi energy. A closer examination 
reveals that the whole spectrum, consisting of various 
butterflies pieced together, is much more delicately con- 
structed than a single butterfly. This is exactly because 
the optimized nesting vector (which jumps from one op- 
timal (M, N) to another as B is varied) makes the spec- 
trum pieced together in such a way that the Fermi energy 
always lies in the largest gap. For comparison we display 
in Fig. ^(b) the energy spectrum when the optimization 
of the nesting vector is neglected with a fixed A. A zigzag 
trajectory of the position at which the largest gap occurs 
corresponds to the gap at E — in (a). 

We can also trace back the mathematical reason why 
we have a butterfly. Namely, the quasi-particle equation 
for the present system happens to coincide to that for 
the 3Dj-butterfly in non-interacting systems previously 
studiedU, in that the two periods Gb, G c (arising from 
uniform B Zl B y ) compete with each other, where a dif- 
ference is that the amplitude of the periodicity is here 
related to the order parameter A. So the spectrum plot- 
ted against B z /B y is in fact expected to have-the same 
structure as Hofstadter's butterfly revealed intil. An im- 
portant distinction from the non-interacting case, how- 
ever, is that the FISDW phase adjust itself in such a way 
that the largest gap in the butterfly has the Fermi energy 
in it. 

So, while in the non-interacting case the butterfly 
structure is observed only around the bottom (or top) 
of the entire band, now we have the butterfly precisely 
around the Fermi level by construction, so the situation 
should be easier to realize experimentally. 



V. DISCUSSIONS 

Intuitive Picture — To help understand the butterfly 
intuitively, we can look at the topology of the Fermi sur- 
face. If we first look at the case of the 3D butterfly in 
non-interacting systems, a typical Fermi surface around 
the band bottom consists of nearly parallel planes with 
a set of holes connecting them as shown in Fig. f|(a). So 
we end up with, topologically, a coexistence of a bunch of 
pipes || y and another bunch || z, and this induces a com- 
petition between the Landau quantizations due to B y and 
B z , which causes the 3D butterfly. If we go back to the 
present FISDW, we can see that the incompletely nested 
Fermi surface has a similar structure after the SDW gap 
formation, as typically shown in Fig. |](b). There we 
display a warped Fermi surface in 3D, where the Fermi 
surface shifted by the nesting vector q is superposed to 
show that how they are interwoven. When the SDW gap 
opens in this incompletely nested Fermi surface in 3D, 



we have a multiply- connected Fermi surface (i.e., a net- 
work of pipes) reminiscent of Fig. ^(a) as well as isolated 
pockets. 

The situation sharply contrasts with the incompletely 
nested Fermi surface in 2D, where we end up with iso- 
lated pipes after the SDW formation. Thus the multiply- 
connected Fermi surface explains how the butterfly-like 
spectrum appears, although, to be more precise, there is 
magnetic breakthrough across the pockets and multiply- 
connected Fermi surface. So we expect that the 3D 
butterfly tends to appear in systems having multiply- 
connected Fermi surfaces. 

Figure [|(b) also explains intuitively why SDW gaps 
are not formed for magnetic fields having 9 ~ 0, 45°, 90°, 
since the semiclassical orbits on the multiply-connected 
Fermi surface are open in this case, so that the SDW for- 
mation is not energetically favorable. Mathematically, 
the divergence of the arguments in Bessel functions men- 
tioned above is related to the configuration of the Fermi 
'pipes'. 

Experimental possibilities — Experimentally, a best re- 
gion to probe in the phase diagram, Fig.|^ to observe 
the 3D FISDW and the 3D butterfly should be where 
the 3D phase is observed for the entire tilting angle 
(0 < \0\ < 45°) of the magnetic field with a fixed \B\. 
This corresponds to a situation, 

t' y ,t' z >eBbv F . (18) 

Why this should be the criterion may be understood as 
follows. The basic equation is written in terms of z\...z§. 
As discussed above, the 3D butterfly is a result of a com- 
petition between the periods Gb,G c . In other words, we 
need to have z%, zq>0(1), since z 3 ,...,z 6 contributes 
to the Fourier component of Gb or G c through J n (z). 
We can exclude zi,Z2 from our analysis, since they are 
always small when (q y ,q z ) ~ (ir, it). So we end up 
with the criterion, t' y ,t' z >eBbv F from the definition of 
Z3,...,ze for b w c. We do not have to add a condition 
t' yz (= 2y/t y t' z )>eBbvF, since this condition is already in- 
cluded in the above one. 

We can give a rough idea how we can realize the above 
condition. If we have a material with, say, t' y ,t' z ~ 10K 
(cf. t' y ~ 10K > t' z in (TMTSF) 2 X) with the values of 
vf, b, c similar to those in (TMTSF^X, then the butter- 
fly and the peculiar quantum Hall effect should be ob- 
served for a moderate B< 10T. The energy scale of the 
butterfly will be t' y or t' z as seen in Fig. |. To have a 
large FISDW gap energy scale, on the other hand, larger 
the |S| the better, since for a small magnetic field (for 
which z's become large) I mn has a spreaded distribution 
against m, n and the gaps become smaller. 
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FIG. 1. The structure of the energy spectrum representing 
Eq.@ in the text. 



FIG. 2. The phase diagram for the FISDW in 3D at T = 
in the weak-coupling regime is shown against (B y ,B z ) for 
t z /U = 1 (a) or 0.7 (b) [i.e., t' z /t' y =1 (a) or 0.49 (b) in 
eq.(|4j)]. The phases are labeled by the quantum Hall integers 
(M,N)[— (a xy ,a zx ) in units of (h/2e 2 )], and those having 
{lyilz) 7^ (""; 7r ) are underlined. We assume b = c, t y /t x = 0.1 
and a — 0.4. The 3D-natured phases are shaded. 

FIG. 3. (a) The quasi-particle energy spectrum against 
B z for tz/ty — 1 with B y fixed to 2.5 (dashed line in Fig. 
1). We assume a coupling constant voDo = 0.34 and the 
cut-off energy E c = 12.5t' y . Vertical lines indicate boundaries 
between different FISDW phases labeled by (M, TV), (b) Simi- 
lar spectrum when we do not optimize the nesting vector (i.e., 
q — (2/cf, 7r, 7t)) with a fixed A(= 0.5t' y here) for comparison. 
The positions of the gaps having the largest I mn are indicated 
by a solid line. 

FIG. 4. (a)A typical Fermi surface for a non-interacting 
quasi-lD system with t x S> t y ~ t z and Ef ~ t y , t z from the 
band bottom. (b)A typical Fermi surface (mesh) superposed 
with the nested one (gray) translated by q for the 3D FISDW 
case. After the SDW gap opening the Fermi surface consists 
of pockets and a multiply-connected network of pipes. Solid 
lines exemplify open orbits for 6 — 0,45°. 
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